VANISHING IDEALS OF LATTICE DIAGRAM DETERMINANTS 
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Abstract. A lattice diagram is a finite set L = {(pi, <?i), • ■ ■ , (p„, q n )} of lattice 
cells in the positive quadrant. The corresponding lattice diagram determinant is 
Al(A„;1^) = det || a^y^ ||. The space Ml is the space spanned by all partial 



derivatives of Ai(X„;F rl ). We denote by M° the y-free component of Ml- For 
fi a partition of n + 1, we denote by fi/ij the diagram obtained by removing the 
cell (i,j) from the Ferrers diagram of \i. Using homogeneous partially symmetric 
polynomials, we give here a dual description of the vanishing ideal of the space M" 
and we give the first known description of the vanishing ideal of M° , t .. 



1. Introduction 

A lattice diagram is a finite set L = {(pi, (ft), • • ■ , (p n , In)} of lattice cells in the 
positive quadrant. Following the definitions and conventions of [||, [7|, the coordinates 
Pi > and qi > of a cell (p i: qi) indicate the row and column position, respectively, 
of the cell in the positive quadrant. For /ii > /i 2 > ■ • ■ > /!& > 0, we say that 
li = (/ii,/i2, ... , Lik) is & partition of n if n = fii + - • - + /ifc. We associate to a partition 
// the following lattice (Ferrers) diagram {(i, j) : < i < k — 1, < j < /ij+i — 1} 
and we use the symbol fi for both the partition and its associated Ferrers diagram. 
For example, given the partition (4, 2, 1), its Ferrers diagram is: 



2,0 






1,0 


1,1 




0,0 


0,1 


0,2 


0,3 



This consists of the lattice cells {(0, 0), (1, 0), (2, 0), (0, 1), (1, 1), (0, 2), (0, 3)}. We list 
the cells in lexicographic order looking at the second-coordinate first. That is: 

(1.1) (pi,9i) < (P2, ?2) ^=^ <?i < <?2 or [qi = q 2 and pi < p 2 ]. 

Given a lattice diagram L = {(pi, 91), (j>2, 92), ■ 



(Pn,qn)} we define the lattice 



diagram determinant 



where X n 



A L (X n ;F n ) = det 



Xn cLllCL Id 



rfi'vV 



PiW 



«,i=i 



xi, x 2 , ■ ■ ■ ,x n ana Y n = y h y 2 , . . . , y n - The determinant A L (X n ; Y n ) is 
bihomogeneous of degree \p\ = p\ + • • • +p n in X n and degree \q\ = q\ + • • • + q n in Y n . 
To ensure that this definition associates a unique determinant to L we require that 
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the list of lattice cells be ordered with the lexicographic order |1 . 1| . The factorials will 
ensure that the lattice diagram determinants behave nicely under partial derivatives. 
For a polynomial P(X n ; Y n ), the vector space spanned by all the partial derivatives 
of P of all orders is denoted Cq[P}. A permutation a G S n acts diagonally on a poly- 
nomial P(X n ; Y n ) as follows: aP(X n \Y n ) = P(x ai ,x a2 , . . . ,x an ;y ai ,y a2 , . . . ,y a J. 
Under this action, AL{X n ;Y n ) is clearly an alternant. Moreover, partial derivatives 
commute with the action, hence it follows that for any lattice diagram L with n 
cells, the vector space Ml = £g[Ai(X n ; Y n )} is an iS n -module. Since AL(X n ;Y n ) is 
bihomogeneous, this module affords a natural bigrading. Denoting by 7i r ^[M L ] the 
subspace consisting of the bihomogeneous elements of degree r in X n and degree s in 
Y n , we have the direct sum decomposition 

M \q\ 
r=0 s=0 

In general, not much is known on the <S n -modules Ml- In the case where L is a Ferrers 
diagram ji with n cells, the n\ conjecture of Garsia and Haiman [JTO]] stated that M M 



has dimension n!, that it is iS ra -isomorphic to the left regular representations and its 



graded character is a renormalization of the Macdonald polynomial |13| indexed by 



\x. Haiman in |12|] has recently completed a proof of this using an algebraic geometry 



approach. It develops that a very natural and combinatorial recursive approach 
to the result above involves diagrams obtained by removing a single cell from a 
partition diagram. In ||, we have investigated this case and formulated various new 
conjectures. 

To pursue the investigation of the spaces Ml, we are interested in an explicit 
description of the vanishing ideal II of differential operators on the spaces Ml, which 
is defined in the following way: 

I L = {P(X n , Y n ) G Q[X n , Y n ] : P(dX n , dY n )A L (X n , Y n ) = 0}, 

where for a polynomial P(X n ; Y n ) we denote by P(dX n ; dY n ) the differential operator 
obtained from P, substituting every variable Xj by the operator |— and every variable 
yj by the operator ^— . A step in this program is to describe the vanishing ideal of a 
special subspace of Ml- For a lattice diagram L, we let 

H 
M L = ^H r ,o[M L }. 

r=0 

That is the y-free component of Ml- In this paper, we study the vanishing ideal 7° 
of differential operator on the spaces M\. Our result gives a good set of generators 
for the ideal 7° in the case where L is a partition /i or a partition with a hole fi/ij. 
The case L = \i was studied extensively in |7|, |8|, [11], [L^]. Our description is dual to 



ro 



Tanisaki's [0, [15]. For L = fi/ij, there was no previously known description of I^ua- 
Our analysis is based on a careful study of the effect of partially symmetric dif- 
ferential operators on lattice diagram determinants. We do this in Section 3. For 
completeness, we also give a description for Schur symmetric differential operators. 
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In Section 4 we recall the known results for 7° and give the dual description using 
homogeneous partially symmetric polynomials. In Section 5 we describe 7°,... 

2. Some preliminary results 

Before we start, let us collect some useful facts. We need a few definitions. For an n- 
cell lattice diagram L, a tableau of shape L is an injective map T : L — > {1, 2, . . . , n}. 
We can think of T as a way to list the cells of L. If T(r, c) = m, we say that hr(i7i) = r 
is the height of m in T. We say that T is column increasing if T(r,c±) < T(r, C2) 
whenever ci < C2 (when this has a meaning). Let 72 be the set of all tableaux of 
shape L and let CTl be the set of all column increasing tableaux of shape L. Finally, 
for any tableau T of shape L, we let 

T(T) = {{T{r, k)\(r, k) e L} j < k < max c} 

(r,c)eL 

be the column sets of T. 

We now expand the determinant 

A L (X n ,Y n ) = ( J] --L) ^ ±m T (y;)m T (X n ) 



where 



(r,c)eL TeT L 



m T (Y n ) = Yl I/T(r,c)> ^t(K) = n arT(r,c)> 

(r,c)eL (r,c)ei 



and the sign is the sign of the permutation that reorders the cells of L given by T 



back in the lexicographic order |1 . 1| . If we now collect the terms of A^(X n , Y n ) with 



the same monomials in Y n , we easily see that 

(2.1) A L (X n ,F n ) = ( 11 -L) ^ m T (y n )A T (X n ) 



r! c\. 

(r,c)GL TeCT L 



where 



( 2 - 2 ) A T (X„)=± J] det||^W|| m/eC . 

cer(T) 

For P(X n ) E Q[X n ], we have 

(2.3) P(dX n )A L (X n ,Y n ) = ^ P(X n )eI° L . 

On one hand, if P(dX n )A L (X n ;Y n ) = then clearly P(dX n )Q(X n ; Y n ) = for all 
Q(X n ;Y n ) e M L . In particular P(9X n )Q(X n ) = for all Q(X n ) G M° C M L and 
P(X„) G 7°. On the other hand, consider the expansion |27i] of A L (X n ;Y n ). For 
any column strict tableau T of shape L we have m T (9y n )A i (X n ; Y n ) = cA T (X n ) 
for a non-zero constant c, and Ar(X n ) G M£. Hence if P(X n ) G 7°, we have that 
P(dX n )A T (X n ) = for all T in the expansion O and thus P{dX n ) A L (X n ; Y n ) = 0. 
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3. Symmetric operators 

For the sake of simplicity, we limit our descriptions to X-operators; the y-operators 
are similar. Recall that 

n 



; I 




% — 1 


■ x ik and 


l<il<i2<---<«fc<n 




"k\-^~n) ~ / j %ii%i2 


X ik 


l<ii<i2<-<Jfe<n 





are the power sum, elementary and homogeneous symmetric polynomials, respec- 
tively. In |2|, H we have described the effect of the above symmetric differential 
operators on lattice diagram determinants. We now recall the results stated in 0. 
In this section we will assume that a lattice diagram is a lists of cells 

L = [(pi, qi), (P2, 92), • • • , On, q n )] 



ordered by the order |1.1| . We allow L to have repeated entries or negative coordinates, 



but in that case we set the determinant A^(X n ; Y n ) = 0. We define the function 

{1 if L has distinct cells in the positive quadrant, 
otherwise. 

Let L be a lattice diagram as above with n distinct cells in the positive quadrant. 
For any integer k > 1 we have: 

Proposition 3.1 (Proposition 1.1 |J). 

n 

Pk (dX n )A L (X n ,Y n ) = J2 ±\^L)( X n,Yn) 

i=l 

where Pk(i, L) is the lattice diagram obtained from L by replacing the i-th biexponent 
(pi, qt) with (pi — k, qi), and the sign of A Pk ^L)(X n ; Y n ) is the sign of the permutation 
that reorders the resulting biexponents in the order [T7~Z| . 

Proposition 3.2 (Proposition 2 0). 

Ck{dX n )A L (X n ; Y n ) = 2_^ ^■e h (h,...,i h ;L)(X n ;Y n ) 

l<ii<i2<---<ik< n 

where ek{ii, ... ,ik\ L) is the lattice diagram obtained from L by replacing the biexpo- 
nents (pi^qtj), • • • , (pi h ,qi h ) with (p h - 1, q h ), . . . , (p h - 1, q ih ). 

For a lattice diagram L with n distinct cells in the positive quadrant, we denote 
by L its complement in the positive quadrant (it is an infinite subset). Again we list 
L = [(Pi) 9i)> (p2> ^2)1 ■ ■ •] using the lexicographic order [TTT| . 
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Proposition 3.3 (Proposition 3 0). 

h k (dX n )A L (X n ;Y n ) = J2 e(ek(h,... ,zjfe,X))A ^- — T) {X n ;Y n ) 

l<ii<i'2<--<ik 

where e^iix, ■ ■ ■ ,h,L) is the lattice diagram obtained from L by replacing the biex- 
ponents (p^ftj , . . . , (p ik ,q ik ) with (p h +l,q h ),... , (p ik + l,q ik ). Its complement is 
Ck{iii ■ ■ ■ ,ik,L) and the function e is defined in \3. i| . 

We remark that even if the sum in Proposition |3.3| is infinite, only a finite number of 
coefficients e(e k (ii, ... , ik, L)) differs from zero. We will give at the end of this section 
an expression for hk(dX n )AL(X n ; Y n ) that does not depend on the complement of 
L. For this, it is natural to ask what is the effect of a Schur differential operator on 
a lattice diagram determinant. For completeness, we insert here such a description 



that unifies Proposition 3.2 and tO. We only sketch a proof of our description since 



this is not used in the remaining sections and the technique of proofs are well known. 



Following fll3fl , recall that for a partition A = (Ai, A 2 , . . . , A&) the conjugate (trans- 
pose) partition is denoted by A' = (\[, \' 2 , . . . ,X' i ). With this in mind, the Schur 
polynomial indexed by A is 

(3.2) S x (X n ) = det || e x > i+j -i(X n ) || = J^ sgn(a)e a{x/+Se) _ 5l ,, 

a-eSt 

with the understanding that eo(X n ) = 1 and e&(X n ) = if k < 0. The Schur 
polynomials also have a description in terms of column-strict Young tableaux. Given 
A a partition of n, a tableau of shape A is a map T: A — *■ {1, 2, . . . , n}. We say that T 
is a column-strict Young tableau if it is weakly increasing along the rows and strictly 
increasing along columns of A. That is T(i,j) < T(i,j + 1) and T(i,j) < T{i + 1, j). 
We denote by T\ the set of all column-strict Young tableaux of shape A. For any 
tableau T, we define X n T = YYi=i x \ ■ As seen i n [13 , we have 

S\{X n ) = 2_^ X n . 
TeT x 

Let L be a lattice diagram with n cells ordered by the order |1.1| . For any partition 
A of an integer k > 1 we have 

Proposition 3.4. 

S x (dX n )A L (X n ,Y n ) = J2 e'(T 1 L)A dT{L) (X n ,Y n ) 

Ter x 

where dT(L) is the lattice diagram obtained from L by replacing the biexponents 
(pi,qi) with (pi — \T~ l (i)\,qi) for 1 < % < n. The coefficient 

e'(T,L) = e(dT(L)) ■■■ e(dT i _ l dT E {L)) e(dT i {L)), 

where Xi, T 2 , . . . , Ti are the l columns ofT and e is the function defined in \3. 1\. 



There are many standard ways to prove this statement. For example one can 
iteratively use the Proposition |3.2| with the expansion |3.2|. Then, Proposition pT3 
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follows by a suitable canceling involution. See |I3J] for a similar involution. A complete 
proof of this Proposition will appear elsewhere [|J . 

Remark 3.5. Given a lattice diagram L and a column strict tableau T G T\, we 
have that e'(T, L) — 1 exactly when we can move the cells of L by one, reading T 
column by column, from right to left, without having any cells colliding. 



Corollary 3.6. For h k (X n ) = S( k )(X n ) we have 
h k (dX n )A L (X n ,Y n ) = 



^2 ^((h, • • • i k), L)A dii ... d . h{L) (X n ; Y n ) 



This is equivalent to the description in Proposition ft.3| . The only way that 
e'((ii, . . . , ife), L) ^ is if the cells z'i, . . . ,4 that move down are moved into holes. 
This can be described as distinct holes moving up. 



For the following sections we now describe a necessary condition that tests if a 
partially symmetric operator belongs to the vanishing ideal of a lattice diagram de- 
terminant. For k < n, fix 

and set S Y = {y^,?/^, . . . ,y« fc }. Given L a lattice diagram with n cells, we can 
expand the determinant A L (X n ; Y n ) in term of the rows i\, i 2 , ■ ■ ■ ,i k and we get 



(3.3) 



Ai(A" n ; Y n ) 



DCL, 

\D\ = k 



±A D (S; S Y )A L _ D (X n -S,Y n -S 



Y\ 



Clearly, if a symmetric operator in the variables S annihilates all Ae>(S; S y ) for D C 
L, then it annihilates A L (X n ; Y n ). For example, let L = {(1, 0), (0, 1), (1, 1), (0, 2)} 
and choose S C X n such that |5| = k = 2. We have that ^(.S) G /£, since for all sub- 
sets Del such that \D\ = 2 the Proposition |3.3| gives us that h 3 (dS)AD(S; S Y ) = 0. 
We can visualize this as follows. We represent all subsets D putting two • in the all 
possible ways inside L. 



• • • 



The maximal number of distinct cells in D that can go up without overlapping another 
in all pictures is two. For example, in the first picture, there are two cells below the 
two •, if we try to move up three cells of D, necessarily at least two will overlap 
and hence hs(dS)Ac(S; S Y ) = 0. Using this technique we can easily check that 
h r (S) G /£ if r > 2 for \S\ = 1, r > 3 for \S\=2, r > 3 for \S\ = 3 and r > 2 for 
\S\=4. 
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4. The ideal J° 

In this section we recall the results [0, [15] for the ideal 1° and give a dual description 
of the ideal in terms of homogeneous partially symmetric polynomials. This gives us 
a better understanding for the case 7°,. . in Section 5. 

Let /ibea fixed partition of n. The homogeneous partially symmetric polynomials 
are the polynomials h r (S) for 5* = {x^, Xi 2 , ... , Xi k } C X n . Let // = (/4, /4; • • • ; /-O 
denote the conjugate partition of //. For 1 < fc < n, we define 

with the convention that //• = if j > m. 
Proposition 4.1. For fi a partition of n 

/J = (fc r (S) :5CI„, |S| = fc, r > 4(/i) - fc>- 
Tanisaki [ 15 1 , with a simplified proof in JFj , shows that 



ij = <e r (5) : 5 C X n , \S\ = k, r > k - (n - 5 n _- k (fx))) 
= (e r (S) : S C X n , \S\=n-k, r > S k (n) - k). 

In light of the following lemma, the Proposition [4.1| is simply the dual description of 
Tanisaki's description of 7° More precisely, using the ideal 

7°. = (e r (X n ) : r > 0) = (h r (X n ) : r > 0) C ij, 
we have: 
Lemma 4.2. For 5 C X„, fet lS = X n -S, then 

h r {S) = (-l) r e r {S) mod 7° n . 
Proof. We know that e r ( S 1 ) and h r (S) are the coefficient of t r in 

%(*) = n^ 1 + **) and ^w = n i37^ 

respectively. Since S U S = X n is a disjoint union, we have that Eg(t)/H s (—t) = 
Ex n (t) = 1 mod Ii„. Hence Eg(t) = H s (—t) mod 7°„ and the result follows. □ 



Remark 4.3. The reader should note that the argument of [0, [H| could be further 



simplified using directly the generators of Proposition |4.1| . As described at the end 
of Section 3, one can easily show that h r (dS)A^(X n ; Y n ) = whenever \S\ = k and 
r > <5fc(/i) — k. This is a simple use of the pigeon hole principle. Then the reduction 
algorithm in the proof of Proposition 4.2 M is better suited to the homogeneous 
functions h k (S). 
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5. The ideal JJ^ 

We describe the vanishing ideal 7° ,. . of the space Mf\- ■ for fi a partition of n + 1 
and (i,j) a cell of \x. In the previous section we have seen that 7° has two dual 
descriptions in terms of elementary partially symmetric function and in terms of 
homogeneous partially symmetric functions. The key idea was that they are both 
equivalent modulo the ideal 7° n of fully symmetric functions that is contained in 
every 7°. To study 1°,-- we do not have J° n C 7°,.-. For example, if (i,j) E \i is 
not at the top of a column of \i then hi(dX n )A fl /ij(X n ; Y n ) = A fl /i + ij(X n ; Y n ) ^ 0. 
On the other hand, as we will see in Lemma |5.2|, h r (X n ) E 7°,.. for all other r > 1. 
To describe 7° ,■ ■ we need to use both families of generators. Let us introduce some 
notation. 



Xo) 



(i,j) 



<^ 



O 



Figure 1 

Let £ be the number of cells above the cell (i,j) in fi. In the area north east of 
the cell (i,j), let (a , A)) be the coordinate of the rightmost corner cell of \i. We let 
v(0) = [i/a [3o be the partition of n obtained from \x by removing the cell (a ,(3 ). 

If (i,j) is at the top of a column of fx, then a^ = i and 

/i 1 ° (dY n )A ll /ij(X n ; Y n ) = A^/ ao p (X Tl ]Y Tl ) = A u ^{X n ;Y n ). 

If P(dX n )A ll/%] (X n] Y n ) = 0, then clearly P(dX n )A u{0) (X n , Y n ) = and I° flJ C 7° (0) . 
To see the other inclusion, we first compare the expansions |2.1| for A M /jj(X n ; Y n ) and 
A v ( )(X n ;Y n ). We have 

A M/<i (X n ;Y n ) = JZ m T(yn)A T (X n ) 
A m (X n -Y n )= J2 m T '(Y n )A T ,(X n ) 

T'eCT v(0) 

There is an obvious bijection CT^/ij — > CT„(p) that preserves the column set 
r(T) = r(T'). Under this pairing T <-> T' we have that A T (X n ) = ±A T /(X n ). If 
P(9X n )A„( )(X n ; F n ) = we must have that = P(dX n )A T >(X n ) = P(dX n )A T (X n ) 
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for all T <^ T' . It follows that P(dX n )A fJi / i j(X n ; Y n ) = and this shows the inclusion 
I^iq) — lu/ij- Hence if (i,j) is at the top of a column of /i, we have 7°,.. = I„( \, a 
case covered in the previous section. For the remaining of this section we can thus 
assume that (i,j) is not at the top of a column of /i. 
For /i a partition of n + 1 let 

J° = (h r (S) :SCX n , \S\ =k, r> SM -k, for 1 < k < n). 

In particular hi(X n ) g" J M , but we clearly have 

Jl C (h r (S) :SCX n , \S\ = k, r> 5 k (fi) - k, forl<k<n + l). 

Thus from Proposition |4.1| it follows that J° C J° We have seen above that the use 
of homogeneous partially symmetric functions may not be enough to describe i"°/ i7 -- 
In our main theorem below, we also need elementary partially symmetric functions. 
Let 

Jj /y = (h 1 (X n )e_ r (S)_.^CX n± \S\=n-k, j<k<(3 ,r = 5M-k) 
+ (e r (S) : 5 C X n , \S\=n- k, /3 < k < jui, r = 4(a*) - &). 

Theorem 5.1. Using the notation above for \x = (//i,//2, ■ ■ ■) a partition of n + 1 
and (i,j) a cell of \x, 

(5.1) I l/v = J l + (^\X n )) + J^ /ij . 

The remaining of this section is dedicated to a proof of this theorem. Let I®,- 
denote the right hand side of Equation 5T| . We first show the inclusion 1°,.. C 1®/^, 
showing that each of the components of 1°/.- belongs to 7°,... 

Lemma 5.2. For any (i,j) € fi, we have 7° C 7°,... 

Proof. It is clear from the definition that JlJ C /|J. Let us use the Equation [O] with 
fj, and x n+ \. 

Afj,{X n ,X n+ i;Y n ,y n+ i)= 2_^ ^ X n+l2/n+l ^fi/ij{X n ', Y n ). 

For any P(X n ) G 7° C 7° we have 

= P(9X n )A M (X n ,x n+1 ;F n ,y n+1 )= ^ ±x; +1 ^ +1 P(9X n )A M/y (X n ;y;) 

which shows that P(dX n )A ll /ij(X n ; Y n ) = for all (i,j) G /i. □ 



To show that h 1 +1 (X n ) e 7°,^. we use the Proposition |3l| In fi/ij the only cell 
that can move up, without overlapping another, is (i, j). It can move up by £, but 
not more. Moving the cell by £ + 1 would be outside of \x hence overlapping another 
cell of fj,/ij. Thus 



M +1 (ax n )A^(x n; y;) = o. 



10 
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Now, for Pq < k < jj,i we consider e r (S) where S C X n of cardinality \S\ 



n 



and r = £&(//) — fe. Again we shall show that e r (S) e 1° /„•„•. We remark that if the 



condition (3 < k < /^ is non-empty, then 
expand A /J , /ij (X n ] Y n ) as in [0| 



[i,j) is not on the first row of /i. We 



M/^iv n ' ^J 



E 

D C p/ij, 

\D\=n-h 



±A D (S;S Y ) 



^■fj,/ij—D\X n O, Y n 



Y 

S ) 



By inspection of Figure 2 below, we note that there are n — k cells in total in the two 
shaded areas of fx/ij. In the darker grey area there are 5k{fJ>) — k — 1 cells of \xjij. 

Y 

According to the Proposition jO| , to have e r (dS)Ar,(S; S ) ^ 0, we must be able to 
move r = Sk{n) — k distinct cells of D down. Among all the diagrams D C fi/ij such 
that \D\ = n — k, the ones that maximize the number of distinct cells that can go 
down are obtained as follows. We must first choose all the cells of /u,/ij that are in rows 
2,3,... , fi[, and there are n — H\ such cells. We must then choose \i\ — k cells in the 
first row. Each cell in the first row prevents the cells above it to move down. We must 
minimize these obstructions and choose cells (0, ji), (0, j'2), • • • , (0,j^i-k) in columns 
j s such that the /i' s are the smallest, and possibly the column j (corresponding to 
the hole (i,j))- Choosing the column j would prevent i > fi' k+1 cells to move down; 
hence up to a permutation of the columns, we may choose j s = k + s. That is the 
diagram D depicted by the two shaded areas in Figure 2. The maximal number of 
distinct cells that can go down for that D is Sk(fj) — k — 1. All other D C fi/ij such 
that \D\ = n — k will have no more than 8k{n) — k — 1 distinct cells that can go 
down, hence e r (dS)A^ i: j(X n ; Y n ) = and e r (S) G I® fij . 



,"(0) 



<r- 



A, 



-> 






Figure 2 



Finally, for j < k < (3$ and e r (S) as above, the only remaining problem with our 
argument is when the cell (i,j) is not in the darker grey area. This happens only if 
i — 0. But recall that hi(dX n )A lt /ij(X n \ Y n ) = A ll /i + ij(X n ; Y n ) and hence 

e r (dS)h 1 (dX n )A fi/ij (X n ;Y n ) = e r (dS)A fi/i+[ _ l \ 



j\^*-ni *n 



0. 
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Thus hi(X n )e r (S) e 1°,-- which concludes the proof of the inclusion 7°,.. C I® /ir 



Let R = Q[xi,X2, 
above shows that 



, Xr 



be the polynomial ring in n variables. The inclusion 



dim (R/I^j) < dim [R/ll /iJt 

thm, modulo 7°,-., that 
of i? as a linear combination of the basis elements of i?//°,-.. This will show that 



We now present a reduction algorithm, modulo JfJ/y, that reduces any basis element 



(5.2) 



dim (i?//J /y ) < dim(i?/7 



o 



and conclude the proof of the Theorem [571 . 



From classical invariant theory, the set 
(5.3) {hx{X n )x?x e j ■ ■■x n n - l 1 : < a < % - 1} 



forms a basis of R, as A runs through all partitions with parts < n. There are many 
proofs of this fact. One that is more adapted to this context can be found in 0, 
Theorem 3.2. We use the basis in [5.3| for our reduction algorithm. 

For < C < £, let v{C) be the partition of n obtained from fi by removing the 
rightmost corner that is north-east of the cell (i + C,j). 



KC) 



Figure 3 

Let £v(£) be class representative for a basis of R/l®,^. Such a basis is given in 
0, 0, |TTJ. Then we let 



(5.4) 



Bp/H = E ^l( X n)^ 



"(0 



C=o 



where h\{X n )B v {£) = {h 1 {X n )P{X n ) : P(X n ) G £v(c)} an d the sum indicates 
(disjoint) union. We need the following lemmas. 
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Lemma 5.3. For < £ < £, we have 

h[(x n )i° u{0 c 7j A , + <^ +1 (x n )>. 

Proof. Let /i r (S') be a generator of 2^ where \S\ = k and r > Sk(y(()) — k. Let 
(a^,/^) be the coordinate of the corner cell such that v(Q = /i/ct^. We note that 

k{ ^ [8M-1 iik>p ( 

If k < /^, then r > <5fc(^(C)) —k = 5k(^) — k and we have h r (S) G J° C i^-. Similarly, 

if fc > (3 C and r > <Jfc(z/(C)) - k + 1 = <J fc (/x) - fc, then again /i^S 1 ) G J° C ]*,„. We 
are left to assume that k > fy and r = Sk(fi) — k. For ( = 0, we have 

J?. = (/i r (X n ) : r > 0) C 7^ + </n(*»)>, 
we can use Lemma [O] and 

M-S) = (-l) r e r (S) mod (i* /y + <^(X n )>), 

where S = X n — S. In this case, e r (S) G J®, { - C 1°,.. and thus /i r (S) G 1°/- + 
(hi(X n )\. For C > 0) according to Lemma [12] again, we have h r (S) = (—l) r e r (S) 
mod /°n. In particular h[(X n )h r (S) = (—l) r hi(X n )e r (S) mod /^(X n )/°„. Since 
/iJ(X n )i?„ C 7° fij + (h\ +1 (X n )), we have 

h[(X n )h r (S) = (-l) r hle r (S) mod (ij /y + (h{ +1 (X n ))). 

In this case, /n(X n )e r (5) G Jj AJ C 7^ and thus h{(X n )h r (S) G 7^. + (h{ +1 (X n )). 

D 



■ ■ "Xn-l W tth 



Lemma 5.4. Modulo 7°,.., any element of the form h\(X n )x^x^ 
< €i < i — 1 is a linear combination of elements in B^/ij . 

Proof. We remark that (h{ +1 (X n ), h 2 (X n ), h 3 (X n ),...)c 7°^.. Hence 

(5.5) xf^-.-x^sO modTj/y 

unless h\(X n ) = h{(X n ) for < ( < £. We then proceed by induction on (, from 
C = £ + 1 down to C = 0. The result is true for ( > £ since h[ +1 (X n ) = mod 7°,... 
For C < £ consider ^(Xn)^ 1 !^ ■ • •x^"T 1 1 . We assume by induction that modulo 
7°,. ., any h^x^x^ ■ ■ ■ x^Si with the number of parts equal to 1 in /i is > £ + 1 and 
< r\i < % — 1, is a linear combination of elements in B^uj. From our choice of <6j,(n, 
there exists an element A in the linear span of Bun such that x^x^ 2 ■ ■ ■ "X^-i = A 
mod I„rty Hence there is an element B G I®, n such that 

(5.6) h[(X n )xfxf ■ ■■x-l = h{(X n )A + h[(X n )B. 
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Here hi(X n )A is in the linear span of h\{X n )B v ^) C B^/ij. From Lemma |573| , 
h{{X n )B E Il fij + (h{ + \X n )). Hence 

h[{X n )B = h\ +1 C mod 7; Ai , 

where C is an element of R. By our induction hypothesis h\ C is in the linear span 

We now recall an auxiliary result from ||. For completeness we will sketch the 
proof but the interested reader will find the complete details in the original paper. 
We have that dim(i?/J°,.) = dim(M°,-). Using this we have 

Proposition 5.5. 

I 

dim(JViJ/tf)>X}|ft,(o| 

C=o 

Sketch of proof. For this, we construct an explicit independent set of the right cardi- 
nality. Recall that for v a partition of n, a standard tableau T of shape v is a tableau 
that is increasing both in rows and columns. We denote by S u the set of standard 
tableaux of shape v. We also associate to each entry j, of a standard tableau T, 
a non-negative integer in the following manner. Let (rj,Cj) be the position of j in 
T, and let k be the largest entry of T, such that c^ = Cj + 1 and k < j. We set 
7r(j) = r j — r k- If there is no such k, set 7t(J) = Tj + 1. 

Recall that for < £ < £ we denote by u(C) = fi/a^fa the partition of n obtained 
from jjl by removing (o^,/^), the rightmost corner that is north-east of the cell (i + 
(,j). For T a standard tableau, let B^ denote the set 

B T = { x^x? 2 ■■■x^ n | < m s < 7T (s) }. 

A basis of M®, ^ , is given by 

B v{0 = {m{dX n )A T {X n ) | T e § KC) , m(X n ) e B T }, 

where A T (X n ) is defined in |2T^ . 

If T is a standard tableau of shape u(Q, and < u < a^ an integer, we denote by 
T] u ^ c the tableau of shape f-i/ufy, such that 

{T(r, c) if c 7^ /?£ or r < w , 

T(r — 1, c) if c = /?£ and r > u . 

In other words, the tableau T f Ui/ g is obtained from T by "sliding" upward by 1 the 
cells in column /?£ that are on or above row w. For fx/ij, we set 

(5.7) Bp/ij = [J-4i+a c -C,/3 C ) 

C=o 
where 
(5.8) Au,fi c = {m(dX n )A TU0( (X n ) | T e S v(0 , m(X n ) e B T }. 
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We prove that fT7\ is an independent set, using a downward recursive argument. Us- 
ing /ii(9X n )A At/i j(X n , Y n ) = A^ /i+1J (X n , Y Tl ) inpTT]we obtain the following. For T a 
standard tableau of shape v(() = fi/a^fa and < u < a^, we have 
/ii(<9X n )A TTu ^(X n ) = A T -\ u+hv (X n ) if u < a c , and if w = a f . It follows from 
Definition 15.8 that 



Ai+i,/3 c if m < a c , 

/ll(9X n )X,/3 c | 

{0} if u = a^ 

We deduce, from the linear independence of B v ^ = A a( ,p<;, that each Au,p c is in- 
dependent. Applying h\{dX n ) in definition ^T7| we readily check that B^/i+ij = 
hx(dX n )B li /i i j. But we know that hi(dX n )A ait p e = {0}, and it is clear that A ai ,p e 
is a subset of B^/y. By the induction hypothesis, B^/i+ij is independent, and a 
counting argument forces the independence of S^/y . D 

To conclude the proof of Theorem [5J] we use Lemma |5.4| to show that 



dim{R/q /ij )<\B (t/ij \=Y l \Bv(o\ 

C=o 



Then the Equation |5]2| follows from the Proposition |5.5|. 



Corollary 5.6. B^m is a basis of R/I®,^. 

Acknowledgments 

We are indebted to Frangois Bergeron and Adriano Garsia for very stimulating 
conversations and suggestions, and we thank Mary-Anne McLaughlin for her care- 
ful reading. We also wish to thank the referee for his/her helpfull comments and 
corrections. 



References 

J.-C. Aval, Monomial bases related to the n\ conjecture, Discrete Math. 224 (2000) 15-35. 
J.-C. Aval, On certain spaces of lattice diagram determinants, To appear in Disc. Math. 
J.-C. Aval, F. Bergeron and N. Bergeron, Lattice diagram polynomials in one set of 
variables, submitted. 

J.-C. Aval and N. Bergeron, Schur Partial Derivative Operators on Lattice diagram deter- 
minants, In preparation. 

F. Bergeron, N. Bergeron, A. Garsia, M. Haiman and G. Tesler, Lattice Diagram 
Polynomials and Extended Fieri Rules, Adv. Math., 142 (1999), 244-334. 
F. Bergeron, A. Garsia and G. Tesler, Multiple Left Regular Representations Associated 
with Alternants of the Symmetric Group, in preparation. 

N. Bergeron and A. Garsia, On certain spaces of harmonic polynomials, Contemp. Math, 
138 (1992), 51-86. 

C. DE CONCINI AND C. PrOCESI, Symmetric functions, conjugacy classes and the flag variety, 
Invent. Math. 64 (1981), 203-230. 

A. M. Garsia and M. Haiman, Orbit Harmonics and Graded Representations, to appear in 
Les editions du Lacim, UQAM, Montreal. 



VANISHING IDEALS OF LATTICE DIAGRAM DETERMINANTS 15 

[10] A. M. GARSIA AND M. HAIMAN, A graded representation model for Macdonald's polynomials, 

Proc. Nat. Acad. Sci. U.S.A. 90 (1993), no. 8, 3607-3610. 
[11] A.M. Garsia and C. Procesi, On certain graded S n -modules and the q-Kotska polynomials, 

Adv. Math. 94 (1992), 82-138. 
[12] M. HAIMAN, Hilbert schemes, polygraphs, and the Macdonald positivity conjecture, J. of the 



AMS, to appear. Sec http://math.ucsd.edu/~mhaiman/ 



[13] I. G. Macdonald, Symmetric functions and Hall polynomials, seconded., Oxford Mathemat- 
ical Monographs, The Clarendon Press, 1995. 

[14] J. B. Remmel and M. Shimozono, A simple proof of the Littlewood-Richardson rule and 
applications, Discrete Math. 193, 1-3 (1998) 257-266. 

[15] T. Tanisaki, Defining ideals of the closure of conjugacy classes and representations of the 
Weyl groups, Tohoku J. Math, 34 (1982), 575-585. 

(Jean-Christophe Aval) Laboratoire A2X, Universite Bordeaux 1, 351 cours de la 
Liberation, 33405 Talence cedex, FRANCE 

(Nantel Bergeron) Department of Mathematics and Statistics, York University, To- 
ronto, Ontario M3J 1P3, CANADA 

E-mail address, Jean-Christophe Aval: aval@math.u-bordeaux.fr 
E-mail address, Nantel Bergeron: bergeron@mathstat.yorku.ca 
URL, Nantel Bergeron: http://www.math.yorku.ca/bergeron 



